Efficacy and harms of tocilizumab for the treatment of COVID-19 patients: A systematic review and meta-analysis

Introduction We systematically assessed benefits and harms of tocilizumab (TCZ), which is an antibody blocking IL-6 receptors, in hospitalized COVID-19 patients. Methods Five electronic databases and two preprint webpages were searched until March 4, 2021. Randomized controlled trials (RCTs) and inverse probability treatment weighting (IPTW) cohorts assessing TCZ effects in hospitalized, COVID-19 adult patients were included. Primary outcomes were all-cause mortality, clinical worsening, clinical improvement, need for mechanical ventilation, and adverse events (AE). Inverse variance random-effects meta-analyses were performed with quality of evidence (QoE) evaluated using GRADE methodology. Results Nine RCTs (n = 7,021) and nine IPTW cohorts (n = 7,796) were included. TCZ significantly reduced all-cause mortality in RCTs (RR 0.89, 95%CI 0.81–0.98, p = 0.03; moderate QoE) and non-significantly in cohorts (RR 0.67, 95%CI 0.44–1.02, p = 0.08; very low QoE) vs. control (standard of care [SOC] or placebo). TCZ significantly reduced the need for mechanical ventilation (RR 0.80, 95%CI 0.71–0.90, p = 0.001; moderate QoE) and length of stay (MD -1.92 days, 95%CI -3.46 to -0.38, p = 0.01; low QoE) vs. control in RCTs. There was no significant difference in clinical improvement or worsening between treatments. AEs, severe AEs, bleeding and thrombotic events were similar between arms in RCTs, but there was higher neutropenia risk with TCZ (very low QoE). Subgroup analyses by disease severity or risk of bias (RoB) were consistent with main analyses. Quality of evidence was moderate to very low in both RCTs and cohorts. Conclusions In comparison to SOC or placebo, TCZ reduced all-cause mortality in all studies and reduced mechanical ventilation and length of stay in RCTs in hospitalized COVID-19 patients. Other clinical outcomes were not significantly impacted. TCZ did not have effect on AEs, except a significant increased neutropenia risk in RCTs. TCZ has a potential role in the treatment of hospitalized COVID-19 patients.


Introduction
Over 500 million people have contracted COVID-19, contributing to the~6.2 million total deaths worldwide [1]. Those with comorbidities such as obesity, asthma, diabetes mellitus, hypertension, and chronic kidney disease are at higher risk of death [2]. Treatment options for COVID-19 patients are limited, including corticosteroids in hospitalized patients requiring supplemental oxygen or remdesivir in those hospitalized patients requiring supplemental oxygen but not mechanically ventilated [3].
Tocilizumab (TCZ) is an intravenous monoclonal antibody that works by blocking the interleukin-6 receptor, which activates this prominent inflammatory cytokine [4]. TCZ was regarded as a potential treatment in hospitalized, severe COVID-19 patients. One limitation of TCZ use is that it costs between $2,700-$5,400 for a single 400 mg to 800 mg doses, which can be used up to two doses in the setting of COVID-19. [5].
Published guidelines of good quality that use Grading of Recommendations Assessment, Development and Evaluation (GRADE) methodology recommend the use of TCZ in COVID- 19. The Infectious Diseases Society of America (IDSA) guidelines, as of August 31, 2021, suggested the use of TCZ in hospitalized patients with progressive severe or critical COVID-19 who have elevated markers of inflammation such as C-reactive protein, serum ferritin, LDH, and IL-6. [6]. The Australian COVID-19 guidelines of April 12, 2022 recommended considering TCZ for the treatment of COVID-19 in adults who require supplemental oxygen, particularly in those with evidence of systemic inflammation [7].
The National Institute for Health and Care Excellence (NICE) of the United Kingdom recommended on April 12, 2022 to offer TCZ to hospitalized adults with COVID-19 who are having or have completed a course of corticosteroids, did not receive another IL-6 inhibitor, and had no evidence of a bacterial or other viral infection. Also, patients need supplemental oxygen and a C-reactive protein > = 75mg/L, or are within 48h of starting high-flow nasal oxygen, non-invasive ventilation or invasive mechanical ventilation [8]. The Pan-American Health Organization of the World Health Organization (PAHO/WHO), as of April 12, 2022, described that TCZ reduced mortality and mechanical ventilation requirements with high quality of evidence, without significantly increasing severe adverse events [9].
We systematically assessed randomized controlled trials (RCTs) and higher quality cohort studies to determine the effects of TCZ on clinical outcomes and adverse events in hospitalized COVID-19 patients.

Data sources and searches
Two investigators (V.P., and A.V.H.) developed the search strategy, which was revised and approved by the other investigators. We searched the following databases until March 4, 2021: PubMed-MEDLINE, EMBASE-OVID, Scopus, Web of Science, the Cochrane Library, medRxiv.org (www.medrxiv.org) and Preprints (www.preprints.org). The PubMed search strategy is shown in the S1 File. There was no language limitation.

Study selection
We included controlled studies (RCTs and cohort studies using inverse probability treatment weighting [IPTW]) in any language reporting benefit or harm outcomes of TCZ as treatment in hospitalized COVID-19 patients. IPTW cohorts allow for balancing treatment groups for patient characteristics, thus making cohorts the closest to a target RCT. IPTW achieves this by using patient weighting and propensity score matching to best estimate the population average treatment effect [10,11]. We excluded studies in non-hospitalized COVID-19 patients. Four investigators (A.P.dR., R.C-V., A.V.H., V.P.) independently screened each record title and abstract for potential inclusion. Three investigators (A.P.dR., R.C-V., A.V.H.,) then assessed full texts of selected abstracts. Discrepancies were resolved through discussion or by another investigator (A.P.).

Outcomes
Primary outcomes were all-cause mortality, clinical worsening and improvement, need for mechanical ventilation, and adverse events. Secondary outcomes were length of hospital stay, and severe adverse events as stated by individual authors. Adverse events included bacteremia/ infection, abnormal liver function, bleeding events, neutropenia, and thrombotic events. Clinical worsening and improvement were extracted as defined by authors. All outcomes were measured by authors at a timeframe of 14 to 28 days.

Data extraction
Three investigators (A.P., A.P.dR., R.C-V.) independently extracted the following variables from studies: study design (RCT vs. IPTW cohort), study setting, country(ies), mean age, proportion of male participants, co-morbidities such as hypertension, diabetes mellitus and heart disease, inflammatory and thrombotic biomarkers, severity of COVID-19 disease according to WHO classification [12], TCZ dose and duration, type of control and description, additional drug interventions, primary and secondary outcomes, and time of follow up. Discrepancies were resolved through discussion or by another investigator (A.V.H.).

Risk of bias assessment
Three investigators (A.P., A.P.dR., R.C-V.) in pairs, independently assessed risk of bias (RoB) by using the ROBINS-I (Risk Of Bias In Non-Randomized Studies of Interventions) tool for cohorts [13] and the Cochrane RoB 2.0 tool for RCTs [14]; disagreements were resolved by discussion with a third investigator (A.V.H.). RoB per domain and per study were described as low, moderate, serious, critical and no information for IPTW cohort studies, and as low, some concerns and high for RCTs. RoB 2.0 evaluates five bias domains: randomization process, deviations from intended interventions, missing outcome data, measurement of the outcome and selection of the reported result. ROBINS-I evaluates seven bias domains: due to confounding, selection of participants into the study, classification of interventions, deviations from intended interventions, missing outcome data, measurement of the outcome and selection of the reported result.

Statistical analyses
We reported our systematic review according to 2020 PRISMA guidelines [15]. We primarily stratified our analyses by study design (RCT vs. IPTW cohort). Inverse variance random effect meta-analyses were performed to evaluate effect of TCZ vs. control on outcomes. Effects of meta-analyses were reported as relative risks (RR) for dichotomous outcomes and as mean difference (MD) for the continuous outcome such as length of stay. The 95% confidence intervals (CIs) of effects were adjusted with the Hartung-Knapp method [16], and the between study variance tau 2 was calculated with the Paule-Mandel method [17]. Heterogeneity of effects among studies was quantified with the I 2 statistic (an I 2 >60% means high heterogeneity). We pre-specified subgroup analyses by severity of COVID-19 disease and RoB; the p for interaction test <0.1 indicated effect modification by subgroup. The meta package of R 3.5.1 (www.rproject.org) was used for meta-analyses. The quality of evidence was evaluated using the GRADE methodology, which covers five aspects: risk of bias, inconsistency, indirectness, imprecision, and publication bias [18]. Quality of evidence (QoE) was evaluated per outcome, and described in summary of findings (SoF) tables; GRADEpro GDT was used to create SoF tables [19]. According to the Cochrane Handbook version 6.2 (February 2021), tests for funnel plot asymmetry should be used only when there are at least ten studies included in the metaanalysis, because when there are fewer studies the power of the tests is low (https://training. cochrane.org/handbook/current/chapter-13).

Risk of bias of included studies
The RCT by Veiga et al. had high risk of bias due to selection of the reported results [26], six RCTs had some concerns of risk of bias due to randomization process, deviations from intended intervention, and selection of the reported results. Hermine et al. [21] and Horby et al. [27] had low risk of bias (S1 Fig in S1 File). Among the IPTW cohorts, Biran et al. [29], Chilimuri et al. [30], Martínez-Sanz et al. [33], Rodríguez-Bano et al. [34], Roumier et al. [36] and Somers et al. [37] were at serious risk of bias. Gupta et al. [31], Hill et al. [32], and Rossi et al. [35] were at moderate risk of bias (S2 Fig in S1 File). Details of assessments of each individual RCT and IPTW cohorts are available in the S2 and S3 Files, respectively.

Subgroup analyses
Most of subgroup analyses by severity and risk of bias in both RCTs and IPTW cohorts were consistent with main analyses (S12 Fig in S1 File).

PLOS ONE
Tocilizumab for treatment of COVID-19

Quality of evidence across outcomes
The QoE of outcomes in RCTs was moderate for five outcomes, low for four outcomes, and very low for three outcomes (Table 1). For cohorts, the QoE of outcomes was worse: moderate for two outcomes, low for two outcomes, and very low for six outcomes ( Table 2).

Main findings
We found that the use of TCZ in hospitalized, moderate to severe COVID-19 patients had a significant relative reduction of all-cause mortality of 11% in RCTs and non-significant relative reduction of 33% in IPTW cohorts. The quality of evidence for all-cause mortality was moderate for RCTs and very low for IPTW cohorts. TCZ also significantly reduced the relative risk of need for mechanical ventilation by 20% in RCTs, with moderate quality of evidence and significantly reduced the length of stay by 1.92 days in RCTs, with low quality of evidence. Clinical improvement or worsening were not significantly affected by TCZ in all studies. Adverse events, severe adverse events, bleeding and thrombotic events were not significantly different between TCZ and controls; however, we found in RCTs a significantly higher risk of neutropenia with very low quality of evidence. Subgroup analyses by severity of disease and by risk of bias were consistent with main analyses.
RECOVERY trial by Horby et al. [27], nor used GRADE methodology to assess quality of evidence. Four [38][39][40]42] reviews included IPTW cohorts and other observational studies. Khan et al. [40], evaluated studies until January 7 th 2021, Hariyanto et al. [39] combined RCTs, cohorts and case-control studies, and Berardicurti et al. [38] did not include RCTs. Current clinical guidelines recommend the use of TCZ in hospitalized, severe COVID-19 patients based on RCT data. The IDSA updated its guidelines [6] to conditionally recommend TCZ in addition to standard of care (i.e., steroids) among hospitalized adults with progressive severe or critical disease and who have elevated markers of systematic inflammation. The Australian guidelines [7] conditionally recommended the use of TCZ for the treatment of COVID-19 in adults who require supplemental oxygen both within and outside the context of a RCT unless contraindicated (e.g., other active severe infections). This recommendation highlighted that significant cost of TCZ may affect equity based on geographical area and access to the drug.
NICE guidelines [8] recommended TCZ offer TCZ to adults in hospital with COVID-19 if all the following apply: 1) they are having or have completed a course of corticosteroids; 2) they have not had another IL-6 inhibitor during this admission; and 3) there is no evidence of a bacterial or other viral infection that might be worsened by TCZ. Also, they need supplemental oxygen and have a C-reactive protein of 75mg/L or more, or are within 48h of starting high-flow nasal oxygen, continuous positive airway pressure, non-invasive ventilation or invasive mechanical ventilation. Finally, the PAHO guidelines [9] found that current evidence of TCZ showed that reduced mortality and need for mechanical ventilation in RCTs with moderate to high quality of evidence. The National Institutes of Health Guidelines [44] do not use GRADE methodology and recommend as of December 16, 2021 that TCZ can be used in hospitalized COVID-19 patients who require supplemental oxygen, high-flow oxygen, non-invasive ventilation, or mechanical ventilation.

What our study adds to the literature
We evaluated RCTs and IPTW cohorts with robust samples sizes that assessed the impact of TCZ on all-cause mortality and other clinical outcomes, the doses delivered were generally similar, and hospitalized patients had moderate to severe disease. We pre-defined the inclusion of higher quality IPTW cohort studies, which resemble a randomized trial (i.e., target trial approach). The similar direction of effect for reductions in all-cause mortality in RCTs and IPTW cohorts is a strength and there was mostly low statistical heterogeneity in meta-analyses of RCTs.
Our review supports the hypothesis that anti-inflammatory therapies are efficacious options for prolonging survival in COVID-19 patients. The antiviral monoclonal antibodies bamlanivimab and casirivimab plus imdevimab are efficacious therapies at preventing hospitalization or emergency visit in the early stages of COVID-19 but do not provide benefit patients with more advanced disease [45,46]. Remdesivir may be effective at hastening clinical recovery of hospitalized COVID-19 patients but does not prolong survival [47,48]. Before TCZ, only corticosteroids have been shown to prolong patient survival and that benefit was predominantly seen in patients with severe COVID-19 [49]. Importantly, TCZ was studied in addition to standard of care COVID-19 therapies which included corticosteroids in every RCT and IPTW cohort except Hill et al. [32]. As such, TCZ can be considered a viable adjunctive option to have better survival rates in severely-ill patients with COVID-19.
Our findings of the effects of TCZ on all-cause mortality and its quality of evidence in RCTs agreed with the meta-analyses of the IDSA [6], Australian [7], and PAHO/WHO [9] guidelines. We used the same set of RCTs, but guideline authors did not describe their methods in detail to judge slightly different effects. Although effects of need for mechanical ventilation with TCZ are similar among the Australian guidelines, PAHO/WHO guidelines and our study, we have differences in the set of RCTs and the quality of evidence. The Australian guidelines [7] evaluated four RCTs (n = 4248), with high QoE; the PAHO/WHO guidelines [9] evaluated 21 RCTs (n = 7655) with high QoE; we evaluated seven RCTs (n = 5269), and concluded moderate QoE. None of those guidelines [6][7][8][9] evaluated specific adverse events.
While we were underpowered to fully assess adverse events, there is a suggestion from our meta-analyses that adverse events were non-significantly more frequent with TCZ and this is supported by the known adverse effects seen when TCZ is used in other diseases [50]. We did find a statistically significant 7.9-fold increase in the risk of neutropenia with TCZ in RCTs and 7.7-fold non-significant increase in IPTW cohorts; however, QoE was very low for both designs particularly due to high RoB and large imprecision of effects. Our assessments of other outcomes like clinical improvement or clinical worsening were underpowered across all studies (701 and 947 patients, respectively). There were no statistically significant differences in the risks of bleeding events and thrombotic events between TCZ and controls in both RCTs and IPTW cohorts, with low heterogeneity of effects within designs, and very low to moderate QoE across outcomes and designs.
Whether TCZ should be used in COVID-19 patients with moderate disease or reserved for severely-ill patients cannot be answered by our systematic review. In RCTs, our survival subgroup analyses in severely-ill patients showed strong reduction in one RCT [20] but in eight moderate or moderate to severe RCTs no significant reductions were seen. However, in IPTW cohorts, TCZ was similarly as effective at improving survival in moderate cases as in more severe cases. For other clinical outcomes and specific adverse events, there were a few studies per severity subgroups (severe, moderate to severe, moderate), and effects were similar across subgroups in most of the analyses. These factors make determining the balance of benefits to harms for tocilizumab in patients with moderate disease difficult.
TCZ is an expensive biological agent for treating COVID-19, so the cost-effectiveness of therapy in moderate disease may not be as strong as in severe disease but this requires further study. In addition, the available supply of TCZ may be an issue for widespread use in COVID-19 while still allowing availability in the treatment of rheumatologic patients. Reserving TCZ for severely-ill COVID-19 patients may preserve the supply of the medication for those most likely to benefit. However, if hospitalizations continue to drop due to public health measures and the impact of SARS-CoV-2 vaccines, there may be ample supply of TCZ for both moderately and severely ill patients with COVID-19.

Limitations
We acknowledge several limitations in our study. First, there was a lack of reporting of clinical outcomes in many of the RCTs and IPTW cohorts. Second, there was a lack of description the degree of mortality effects among patients with moderate disease vs. severe disease; several studies included a mix of moderate and severe patients. Third, the outcomes clinical improvement and clinical worsening were markedly underpowered, and their definitions were heterogeneous across studies. Fourth, no IPTW cohorts reported on the occurrence of adverse events. Finally, the finding of higher risk of neutropenia was based on few events and studies, and we found this outcome had very low quality of evidence for RCTs and IPTW cohorts.

Conclusions
Our meta-analysis showed that the use of tocilizumab in patients with moderate to severe COVID-19 reduced all-cause mortality in all studies, and the need for mechanical ventilation and length of stay in RCTs. Also, tocilizumab non-significantly increased clinical improvement in addition to corticosteroid therapy. In addition, we showed no differences in the risk of adverse events or severe adverse events such as bacteremia or infection, but tocilizumab increased the risk of neutropenia, abnormal liver function, and bleeding events vs controls in both RCTs and IPTW cohorts. In particular, tocilizumab significantly increased the risk of neutropenia in RCTs, although quality of evidence was very low. The degree of all-cause mortality benefit and further risks of tocilizumab use in the subset of people with moderate versus severe COVID-19 requires further study.